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Abstract 

In this paper we continue the study of conditional Markov chains (CMCs) with 
finite state spaces, that we initiated in Bielecki, Jakubowski and Niew^glowski (2015) 
in an effort to enrich the theory of CMCs that was originated in Bielecki and Rutkowski 
(2004). We provide an alternative definition of a CMC and an alternative construction 
of a CMC via a change of probability measure. It turns out that our construction 
produces CMCs that are also doubly stochastic Markov chains (DSMCs), which allows 
to study of several properties of CMCs using tools available for DSMCs. 
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1 Introduction 

In this paper we continue the study of conditional Markov chains (CMCs) with finite state 
spaces, that we initiated in Bielecki, Jakubowski and Niew^glowski [5] in an effort to enrich 
the theory of CMCs that was originated in Bielecki and Rutkowski [9]. 

CMCs were conceptualized in the context of credit risk, where they have been found to 
provide a useful tool for modeling credit migrations. In many ways, a CMC is an important 
generalization of the concept of a default time with stochastic compensator, a key concept in 
the models of financial markets allowing for default of parties of a financial contract. Such 
a model of default time is really just a special example of a CMC: it is a CMC taking values 
in a state space consisting of only two states, say 0 and 1, where 0 is the transient state and 
1 is the absorbing state. 

In [5] we proposed a modified definition of the conditional Markov property, which was 
less general than Definition 11.3.1 used in Chapter 11.3 in [9]. The reason for this was 
that the definition of conditional Markov property proposed in [5] was aimed at providing 
a suitable framework for study of Markov consistency properties for conditional Markov 
chains and study of Markov copulae for conditional Markov chains, a feature that can not 
be achieved within the framework of the CMC framework proposed in [9]. Still, the definition 
of the conditional Markov property, and the related construction of a CMC as presented in 
[5] were not general enough, as they did not allow for study of conditional Markov families. 
This is because in [5] we only dealt with processes starting from a fixed, non-random, initial 
state. Here, we generalize the definition of a conditional Markov property and construction 
of a CMC that allow for the initial state of the chain to have a nondegenerate conditional 
initial distribution, and, consequently, allow for study of conditional Markov families. Such 
study will be conducted elsewhere. 
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Classical conditional Markov chains, that is, the ones defined originally in [9], have al¬ 
ready proven to play important role in applications in finance and in insurance, for example 
(cf. Bielecki and Rutkowski [7], [8], [9], Jakubowski and Niew^glowski [21], Eberlein and 
Ozkan [13], Eberlein and Grbac [12], Biagini, Groll and Widenmann [2]). The main advan¬ 
tage of these processes is that, via appropriate conditioning, their primary Markov properties 
are mixed with dependence of their infinitesimal characteristics on relevant random factors, 
that do not have to be Markovian. The CMCs studied in this paper may lead to many 
more applications since, as already has been mentioned above, the present modified defini¬ 
tion allows to study dependence properties between CMCs, which are crucial in applications 
to credit and counterparty risk, among other applications. In fact, the present paper is a 
companion paper to Bielecki, Jakubowski and Niew^glowski [6], where we complement the 
study done here by investigating the issues of modeling dependence between CMCs, and we 
propose some specific applications. 

An important family of jump processes, so called doubly stochastic Markov chains 
(DSMC), was introduced in Jakubowski and Niew^glowski [20]. The conditional Markov 
chains constructed in the present paper turn out to be doubly stochastic Markov chains. 
Thus, the benefit from the construction provided here is two-fold: 

• The constructed CMCs enjoy the conditional Markov property, which has unquestion¬ 
able practical appeal, and 

• The constructed CMCs enjoy the doubly stochastic Markov property, which has critical 
theoretical implications allowing for applying important tools from stochastic analysis 
to studying CMCs. 

The paper is organized as follows: In Section 2 we introduce the concept of CMC, which 
underlies the present study. In this section we also introduce and discuss the relevant concept 
of stochastic generator (or an intensity matrix) of a CMC. In addition, we give there two 
examples of (F, G)-CMC, one which does not have the intensity, and one with the intensity. 
Section 3 is devoted to presentation of a specific method for constructing a CMC. In Section 
4 we relate conditional Markov chains to doubly stochastic Markov chains. In particular, we 
show that any conditional Markov chain constructed using the change of measure technique 
used in Section 3 is also a doubly stochastic Markov chain. Finally, in the last section we 
collect all needed technical results used throughout the paper. 

2 Conditional Markov Chain and Its Intensity 

Let T > 0 be a fixed finite time horizon. Let (O, A, P) be an underlying complete probability 
space, which is endowed with two filtrations, F = {J't)te[o,T] = {St)te[o,T]: that are 

assumed to satisfy the usual conditions. The standing assumption though will be that all 
filtrations used in the paper are completed, with respect to relevant probability measures. 
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For the future reference we also define 

Gt-=J^T'^Qt, te[0,T], (2.1) 

as well as the corresponding filtration G := {Gt)t£[o,T]- In what what follows, we will not 
require that it is right-continuous. 

Typically, processes considered in this paper are defined on (n,M, P), and are restricted 
to the time interval [0, T]. Moreover, for any process U we denote by the completed 
right-continuous filtration generated by this process. In addition, we fix a finite set S, and 
we denote by d the cardinality of S. Without loss of generality we take S = {1,2,3,...,4. 

Definition 2.1. An S-valued, G-adapted cddldg process X is called an (¥,G)-conditional 
Markov chain if for every xi,... ,Xk € S and for every 0 < t < ... < tfc < T it satisfies 
the following property 

F(Xfj =xi,...,Xt^ =Xk\XtyGt) =P(^ii =xi,...,Xtj^ = Xk\Tty (j{Xt)). (2.2) 

Remark 2.2. (i) We will call filtration G the base filtration, and we will call filtration F the 
reference filtration. Usually G = F^. 

(ii) It needs to be stressed that an (F, G)-conditional Markov chain may not be a classical 
Markov chain (in any filtration). However, if G is independent of F, then the above definition 
reduces to the case of a classical Markov chain with respect to filtration G, or G-Markov 
chain. In other words, a classical G-Markov chain is an (F, G)-conditionaI Markov chain for 
the reference filtration independent of the base filtration. 

In what follows we shall write (F,G)-CMC, for short, in place of (F, G)-conditional 
Markov chain. 

2.1 Intensity of an (F,G)-CMC 

Let X be an (F, G)-CMC. For each x € 5" we define the corresponding state indicator process 
of X, 

Hf te[0,T]. (2.3) 

Accordingly, we define a column vector Ht = {Hf,x €5)"'', where T denotes transposition. 
Similarly, for x,y (z S, x ^ y, we define process that counts the number of transitions 
from X to y, 

Hfy := #{u<t: Xu- = x and = y} = [ Hf_dHy, t € [0, T] . (2.4) 

J]o,t] 

The following definition generalizes the concept of the generator matrix (or intensity 
matrix) of a Markov chain. 

Definition 2.3. We say that an ¥-adapted (matrix valued) process At = [^t'^]x,y£S such that 
> 0, yx,y€iS,x^y, and = Vx G 5, (2-5) 

y&S 
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is an ¥-stochastic generator or an¥-intensity matrix process for X, if the process M := {M^,x 
defined as 

Mt = Ht-[ A^Hudu, te[0,T], (2.6) 

Jo 

is an¥ V G - local martingale (with values in 

Remark 2.4. We remark that even though the above definition is stated for an (F,G)-CMC 
process X, it applies to S'-valued semimartingales. 

We will now discuss the question of uniqueness of F-intensity. 

Definition 2.5. We say that two processes A and A are equivalent relative to X if 

rt 

(A« - K)^Hudu = 0, Vt G [0,r]. (2.7) 


/ 


Proposition 2.6. Let X be an (¥,G)-CMC. 

i) If A and A are ¥-intensities of X, then they are equivalent relative to X. In particular 
¥-intensity of X is unique up to equivalence relative to X. 

ii) Let A he an ¥-intensity of X. If A is an ¥-adapted process equivalent to A relative to 
X, then A is ¥-intensity of X. 

Proof, i) By assumption, M given by (2.6) and M defined as 

Mt = Ht - [ h^Hudu, tG[0,r], 

Jo 


are F V G-local martingales. We have that 


Mt - Alt = 


[\k 

Jo 


^m) Hy^du. 


Thus M — M is a continuous finite variation F V G-martingale starting from 0, and hence it 
is a constant null process. Thus (2.7) holds. 

ii) Note that (2.7) implies that for F V G martingale M given by (2.6) it holds 


rt P ^ P ^ 

/ /a a X u _ u I AT ] 


Alt = Ht- [ A^ Hudu + / (A„ - A„) ' Hudu = Ht - I A^ Hudu, t e [0, T] 

Jo Jo Jo 

Thus A is an F-intensity of X. □ 

In [6, Example 3.9] we exhibit an (F, G)-CMC X, which admits two different intensities 
T and A that are eqivalent relative to X. 

In the case of classical Markov chains with finite state space, intensity matrix may not 
exist if the matrix of transition probabilities is not differentiable (e.g. when X is not quasi 
left continuous). In the case of (F,G)-CMC the situation is similar. That is, there exist 
(F, G)-CMCs that do not admit F-intensities. We illustrate this possibility by means of the 
following example (see [5] for details): 
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Example 2.7. Suppose that (r2,M, P) supports a real valued standard Brownian motion 
W, and a random variable E with unit exponential distribution^ and independent from W. 
Define a nonnegative process 7 , by formula 

7 t := sup Wu, t>0. 

u£[0,t] 

By definition, 7 is an increasing and continuous process. It is well known (cf. Section 1.7 
in ltd and McKean [17]) that trajectories of 7 are not absolutely continuous with respect to 
the Lebesgue measure on real line. It is shown in [5] that the process X defined by 

■= l{r<t}5 i > 0 , 

where 

T := inf {t > 0 : 7 t > E} 

is an (F^,F^)-CMC which does not admit an F^-intensity matrix. 

Theorem 2.8 below provides more insight into the issue of existence of F-intensity for an 
(F,G)-CMC. 

2.1.1 Intensity of an (F,G)-CMC and F V G-compensators of counting processes 

}j^y 

The F-intensity matrix of an (F, G)-CMC X is related to the FVG-compensators of processes 
, x,y £ S, X ^ y. In fact, we have the following result, which is a special case of [20, 
Lemma 4.3 ], which deals with general jump semimartingales, and thus its proof is omitted. 

Theorem 2.8. Let X be an {¥,G)-CMC. 

1) Suppose that X admits an V-intensity matrix process A. Then for every x,y € S, 
X y, the process admits an absolutely continuous F V G-compensator given as 

du, i.e. the process defined by 

Rxy ^ _ /■' H^x^ydu, t £ [ 0 , T], ( 2 . 8 ) 

Jo 

is an F V G - local martingale. 

2 ) Suppose that we are given a family of nonnegative ¥ -progressively measurable processes 

, x,y £ S, X y, such that for every x,y £ S, x y, the process K^y given in 
(2.8) is an F V G-local martingale. Then, the matrix valued process At = [Xt^]x,y£S> 
with diagonal elements defined as 

X^^ = - 

y€S,yjtx 

is an ¥-intensity matrix of X. 


^That is, E is exponentially distributed with mean 1. 
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We see that the F-intensity may not exist since F V G-compensators of may not 
be absolutely continuous with respect to Lebesgue measure. On the other hand, absolute 
continuity of F V G-compensators of all processes 77^^, for x,y £ S, x ^ y, is not sufficient 
for existence of an F-intensity. This is due to the fact that the density of F V G compensator 
is, in general, F V G-adapted, whereas the F-intensity is only F-adapted. 

In order to focus our study, we now introduce the following restriction: 

In the rest of this paper we restrict ourselves to CMCs, which admit F-intensity. 

CMCs that do not admit intensities will be studied in a follow-up paper. 

2.2 (F, G)-CMC as a pure jump semimartingale 

It is important to note that an (F, G)-CMC X admitting F-intensity process A can be 
viewed as a pure jump semimartingale, ^ with values in 5, whose corresponding random 
jump measure // defined by (cf. Jacod [18]) 

dt, dz) = E 

s<T n>l 

where 

Tn := inf {t : T^-i <t<T, Xf ^ AT, Tq = 0, 

has the F V G predictable projection under P (the (F V G, P)-compensator) given as 

u{uj,dt,dz) = ^ 5y-x{dz)\'l'^'^dt = '^t{Xt=x}(^ ^ 6y-xidz)Xt^'^dt. 

x&S y€S\{x} xGS y£S\{x} 

(2.9) 

So the problem of construction of an (F, G)-CMC with an F-intensity (matrix) process A 
is equivalent to the problem of construction of any G-adapted, S'-valued pure jump semi¬ 
martingale with the (F V G, P)-compensator v given by (2.9), and additionally satisfying 
condition (2.2). 

Remark 2.9. With a slight abuse of terminology, we shall refer to a G-adapted, 5-valued pure 
jump semimartingale X with the F V G compensator u given by (2.9), as to a G-adapted, 
5-valued pure jump semimartingale admitting the F-intensity process A. In particular, this 
also means that the process M corresponding to X as in (2.6) (see Remark 2.4) is an FVG- 
local martingale and, even though X is not necessarily (F, G)-CMC, the conclusions 1) and 
2) of Theorem 2.8 hold. 

Theorem 2.11 below shows that a G-adapted, 5-valued pure jump semimartingale ad¬ 
mitting F-intensity process A is, under some additional conditions, an (F, G)-CMC with the 
same F-intensity process A. Before stating the theorem, we recall the notion of immersion 
between two filtrations. 

^We adhere to the standard convention that semimartingale processes (taking values in finite dimensional 
spaces) are cMlag. 
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Definition 2.10. We say that a filtration F is ¥-immersed in a filtration El if F C H and 
if every (P,F)-local martingale is a (F, H)-local martingale. 

We now have, 

Theorem 2.11. Assume that 


F is ¥-immersed in F V G. (2.10) 

Let X be a G-adapted, S-valued pure jump semimartingale admitting the V-intensity process 
A. Moreover suppose that 

all real valued F — local martingales are orthogonal to components x € S, (2.11) 
of process M given by (2.6). 

Then X is an {¥,G)-CMC with the ¥-intensity process hA 

Proof. Let us fix 0 = to < ti < ... < t^ < T, and xi,..., € S'. It is enough to show that 

the martingale N, given as 

Nt = F(Xtj =xi,...,Xt^= Xk\Xt V Gt), t € [0,r], 

is such that Nt is Xt V cr{Xt) measurable for any t G [0,ti]. Indeed, this implies that 

¥{Xt^ =xi,...,Xt^^ = Xk\Xt V Gt) = F(Wj =xi,...,Xt^= Xk\Xt V (T{Xt)), t G [0,ti], 

which is the (F,G)-CMC property. To this end, for each n = 1,... ,k, we define a process 
^t'by 

n—1 / k—1 \ 

■■= n HM,=.^]Hj¥iZtYt^e^^ J] 1-^*) > ^ ^ [0 ,r], 

1=1 ^ m=n ' 

where e^ denotes a column vector in with 1 at the coordinate corresponding to state x 
and with zeros otherwise, and Z, Y are solutions of the random ODE’s^ 

dZt = —AtZtdt, Zq = I, t G [0,r], 

dYt = YtAtdt, Yo = l, tG[0,r]. 

We will show, that 

Vf" = Nt, for t G [tn-i,tn\, n = l,2,...,k, (2.12) 

which, in particular, implies that for every t G [0, ti] the random variable Nt = Vf is 
measurable with respect to Xt V a{Xt). 

^We refer to He, Wang and Yan [16, Definition 7.33], for notion of orthogonality of local martingales. 
^The symbol ”1“ used below is a generic symbol for the identity matrix, whose dimension may vary 
depending on the context. 
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We first note that, in view of Lemma 5.5 in Appendix B, the process C"' is an F V 
martingale on Moreover, we have that 


V.^ = 

t-n In 


(2.13) 


Indeed, 


1=1 ^ 


n—1 


k-1 

n+l^^n +1 + 

m=n+l 

k-1 


1=1 ^ m=n+l 

n—1 / k—1 

^{Xt^=Xi}^tn^i ^tn^tn^Xn^Xn^in^tn^l^Xn^l 


tl ~LJ -,L X 

1=1 ^ m=n+l 

n—1 / fc—1 \ 

1=1 ^ m=n ^ 

where the third equality follows from Lemma 5.4 formula (5.7), and from the fact that 

nj ex al = al eJ . 

in ‘^ri tn tn ‘^ri Xn 

We will hnish the proof by demonstrating (2.12) with use of backward induction. Towards 
this end, we start from the last interval, i.e. n = k. Observing that 

= Yl^{Xti=xi}Hj^^( Zt^Yt^^exJ^tk') = Y\.^{Xn=xi}Hj^ex^^ = Y[T^{Xti=xi}, 


1=1 


1=1 


1=1 


and using the martingale property of on [tk_i,tk], we conclude that for t £ [tk-i,tk] 

VA = E(V )^\Tt V Gt) = P(Xt, = xi,..., W, = XfclT) V Gt) = Nf 

Now, suppose that for some n = 2,..., A: — 1, the process coincides with N on [tn-i,tn]- 
This, together with (2.13), yields that 

Ah = i/T = vr-~^. 

In — l tji—X t^i—X 

Thus, by the martingale property of V'^~^ on the interval we obtain that 

= E(W_JJ) V Gt) =Nt, t £ [t„-2,tn-l]. 

So the (backward) induction principle completes the proof. 

□ 
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Remark 2.12. A sufficient condition for orthogonality of real valued F-local martingales 
and components of process M is that F-local martingales and the process M do not have 
common jumps or, equivalently, that F-local martingales and the process X do not have 
common jumps. Indeed, let Z be an (F, P) - local martingale. Since is a local martingale 
of finite variation we have that 

[Z,M%= Y, Y tG[0,r]. 

0<w<t 0<w<t 

Now, note that X jumps iff one of the processes H^,x G S, jumps. Thus if X and Z do 
not have common jumps then [Z, M^] is the null process, hence it is a local martingale. 
Consequently Z and are orthogonal local martingales. 

We complete this section with the following proposition, which furnishes an interesting 
example of filtrations F and G that satisfy conditions (2.10) and (2.11) of Theorem 2.11. 

Proposition 2.13. Let X he an S-valued pure jump semimartingale in its own filtration. 
Let W be a Brownian motion in filtration \/¥^. Then (2.10) and (2.11) of Theorem 2.11 
are satisfied with G = F^ and F = F’^ . 

Proof. Note that W is also F^ Brownian motion, thus any square integrable F'^-martingale 
N can be represented as 

Nt = Nq + f (fudWu, t G [o,r], 

do 

for some F-predictable process cf. The assumption that VC is a Brownian motion in F'^ VF^, 
implies that N is also an F^ VF^-martingale. This proves that F'^ is immersed in F'^VF^. 
So (2.10) holds. Condition (2.11) is satisfied, since all F^ martingales are continuous. 

Remark 2.14. The assumption that VC is a Brownian motion in the filtration F'^ V F'’^ is in 
fact equivalent to immersion of F'^ in F'^ V F^. 

3 Construction of (F, G)—CMC via change of measure 

The construction of CMC given in this section generalizes the construction provided in [5]. In 
[5] the authors constructed CMCs that are starting from a given state with probability one. 
Here, we construct a process (A't)jgjQ such that X is an (F, G)-CMC with the F-intensity 
matrix process A, and with Xq satisfying 

P(Ao = x\Xt) = P(A:o = x\To), xgS. (3.1) 

Even though in case of ordinary Markov chains a construction of a chain starting from a 
given state with probability one directly leads to construction of a chain with arbitrary 
initial distribution, this is not the case any more when one deals with CMCs. In fact, some 
non-trivial modifications of the construction argument used in [5] will need to be introduced 
below. 
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3.1 Preliminaries 

In our construction we start from some underlying probability space, say (P, A, Q), on which 
we are given: 

(11) A (reference) filtration F. 

(12) An S'-valued random variable such that for any x € S' we have that 

Q(C = x\J^t) = fJ-x, (3.2) 

for some ^ measurable random variable fix taking values in [ 0 , 1 ]. 

(13) A family J\f = {N^y)x^y£S of mutually independent Poisson processes, that are 

y^x 

independent of V cj(^) and with non-negative intensities {a^y)x^y£S (of course for 
= 0 we put = 0). 

Remark 3.1. We observe that condition (3.2) is satisfied iff ^ , where is J-q- 

measurable and is orthogonal to Tt^ . Indeed. First, assume (3.2). Since conditional ex¬ 
pectation with respect to Ft is an orthogonal projection from A, Q) onto Ft-, Q) 

we have that ^ where is Ft measurable and is orthogonal to Ft, so that 

E(^"|J^'r) = 0. Using (3.2) we see that is Fq measurable. Conversely, if ^ where 

is Fq measurable and is orthogonal to Ft then (3.2) is obviously satisfied. 

In what follows we take 

ft=( V ^U')v<^{«). (3.3) 

x,y€S 

y^x 

which is known to be right-continuous (see [1, Proposition 3.3] ). 

Given G defined in (3.3), we will construct G-Markov chain, say X, as a solution of 
an appropriate stochastic differential equation. This is an intermediate step in our goal of 
constructing an (F, G)-CMC with the F-intensity matrix process A, and with Xq satisfying 

P(Ao = x|J-t) = F(A:o = x\Fq), xeS, (3.4) 

for a measure P to be constructed later. 

Proposition 3.2. Let A = [a^^jx^yes, where the diagonal elements of A are defined as 
qXx ;= —'^y^ga^y. Assume that ^ is an S-valued random variable and M = are 

y^x 

Poisson processes satisfying (13). Then the unique strong solution of the following SDE 

dXt = xn{x}{Xt-)dNfy, t G [0,T], Ao = e, (3.5) 

x,y£S 

x^y 

is a G - Markov ehain with the infinitesimal generator A. Moreover, A is an ¥-intensity of 
X under Q. 


®A random variable and sigma field Ft are said to be orthogonal if EQ{^"g) — 0, for every rj £ L°°{Ft)- 
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Proof. In view of (13), the processes and , y 7 ^ ?/', do not jump together. Thus, 
the process defined for x, y G 5, x 7 ^ y by 

Hfy = f Hf_dN^y, te[o,T], 

Jo 

(cf. (2.3) for definition of H^) counts number of transitions of X from state x to state y. 
Independence of from Tt V (t(,^) implies that is also a G-Poisson processes with 
intensity Thus, by boundedness and G-predictability of {Ht-)t£[o,T]i the process 
given as 

Lfy = f idKy - a-ydu) = Hfy - f Hf_a^ydu = nfy - f Hfa^ydu, t G [O, r], 

Jo Jo Jo 

(3.6) 

is a G-martingale. Consequently, application of relevant characterization theorem [20, Thm. 
4.1] yields that X is a G-Markov chain with the infinitesimal generator A. 

To finish the proof we observe that since X given by (3.5) is a pure jump process with 
finite variation, it is a semimartingale. The (G, Q)-compensator of the jump measure of 
X, that is, the jump characteristic of X relative to (G,Q), is given in terms of matrix A 
(cf. (3.6)). Moreover, since X is adapted to filtration F V G C G, then we see that X is 
a semimartingale with the (F V G, Q)-compensator of its jump measure given in terms of 
matrix A. Now, A is F-adapted (since it is deterministic), so, in view of the terminology 
introduced earlier (cf. Definition 2.3), A is an F-intensity of X under Q. □ 

The fact that X is a Markov chain in filtration G will be critically important below. 

3.2 Canonical conditions 

Let At = [A^^j x,yes be matrix valued process satisfying the following conditions: 

(Cl) A is an F-progressively measurable and it fulfills (2.5). 

(C2) The processes x,y G S, x ^ y, have countably many jumps Q-a.s, and their 
trajectories admit left limits. 

Definition 3.3. A process A satysfying conditions (Cl) and (C2) is said to satisfy canonical 
conditions relative to the pair (S', F). 

Any F-adapted cadlag process At = [A^^]a;,j/G 5 , for which (2.5) holds, satisfies canonical 
conditions. 

We are now ready to proceed with construction of a CMC via change of measure. 

3.3 Construction of a CMC 

In this section we provide a construction of a probability measure P, under which the process 
X following the dynamics (3.5) is an (F, G)-CMC with a given F-intensity matrix A and 
with Xr-conditional initial distribution satisfying (3.4). 
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Theorem 3.4. Let A satisfy canonical conditions relative to the pair (5, F) and assume that 
^ satisfies (12). Suppose that introduced in (13), is strictly positive for all x,y (z S, 
X y. Moreover, let X be the unique solution of SDE (3.5). For each pair x,y (z S,x y, 
define the processes as 

\xy 

= ^e[o,r], 

and assume that the random variable i? given as 

d= n exp [ - r Hf_a-yK(ydv^ 11(1 + 
x,y&S:x^y \ do J o<m<T 

satisfies Eq-!? = 1.® Finally, define on {Q,Qt) the probability P by 


Then 



(3.7) 


(^) 




(3.8) 


(a) X is an {¥,G)-CMC under P with the ¥-intensity matrix process A, and with the 
initial distribution satisfying 


¥{Xo = x\Tt)=¥{Xo = x\Fo) = Q{Xo = x\Ft), x € S. (3.9) 


Proof. In view of Theorem 2.11, in order to prove (ii) it suffices to prove that: 

(a) under measure P process X has an F-intensity A, 

(b) F is P-immersed in F V G, 

(c) all real valued (F, F)-martingales are orthogonal (under P) to martingales M^, x ^ S, 

(d) (3.9) holds. 

We will prove these claims in separate steps. In the process, we will also demonstrate (i). 
Step 1: Here we will show that A is an F-intensity of X under P. Towards this end, we 
consider a G-adapted process rj given as 

Vt= n llil + KfyAHfy), t€[0,T], 

x^y£S\x^y \ 0 / 

SO that 

dpt = Vt- I K^ydL^y^ , 7?o = 1, 

\x,yeS-.xj^y j 

®There exist many different sufficient conditions ensuring that Ejjd = 1. For example uniform bounded¬ 
ness of A is such a condition. 
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where is a (G, Q)-niartingale given by (3.6). Consequently, process r/ is a (G,Q)-local 
martingale. Now, note that r/x = and thus = 1 = ?yo- Thus r] is (G, Q)-martingale 

(on[0,T]). 

Since is a left-continuous and F-adapted process, and since F C G, we conclude that 
is G-predictable. Thus, by the Girsanov theorem (see Bremaud [11, Thm. VI.T3]), 
we conclude that the (G,P) compensator of H^y has density with respect to the Lebesgue 
measure given as^ 

/ \^y \ 

l|,}(Vt_)a"^(l + <") = (^1 + ^ - ij = t G [o,r]. 

So, for any x ^ y, the process K^y defined as 

K^y :=H^y- 

Jo 

is a G - local martingale under P. Since X is a cadlag process and since satisfies condition 
(C2) we see that 

k^y = H^y - f Kx^ydu, t g [o,t], ( 3 . 10 ) 

Jo 

is a G-local martingale under P. Note that F V G C G and that the process K^y is 
F V G-adapted. Taking 

Tn '■= inf |t > 0 : H^y > n or J X^du > n| 

gives us a reducing sequence of G stopping times for which are also F V G stopping 
times. So, in view of [14, Theorem 3.7], we have that K^y is also a F V G-local martingale. 
Thus according to Remark 2.9 we can use Theorem 2.8 to conclude that A is an F-intensity 
of X under P. 

Step 2: In this step we prove (3.8). By definition of P and by the tower property of 
conditional expectations we conclude that for an arbitrary ijj G L°°{JFt) we have 

Fp('i/’) = Eq(V’??t) = FQ(EQ('0ryT|I?o)) = EQ(V’EQ(ryT|I?o)) = EQ('i/;). 

Step 3: Next, we show that F is P-immersed in F V G. In view of Proposition 5.9.1.1 
in Jeanablanc, Yor and Chesney [22] it suffices to show that for any ?/) G L°°{JFt) and any 
t G [0, T] it holds that 

Ep(i/>|X) V ^t) = Ep(i/>|X)), P-a.s. (3.11) 

Now, observe that 

P(7yj > 0) = Eq(1{^^>o}^t) > ]EQ(l{^j,>o}ryT) = ^QiVT) = 1, 
use the usual convention that Uo- ’■= 0 for any real valued process U. 
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so that ¥{r]t > 0) = 1. Moreover, r]t is J-t V Qt measurable by (13), (3.6) and (Cl). Thus we 
have ^ 

y Gt) EQ(V^EQ(77r|^t)|J't v^t) 

^ Ea(i/.tft|r, V g,) ^ y ^ Eq(</.|7-,), p-o.s, 

where the third equality holds in view of the fact that rj is (G, Q)-martingale, and where the 
last equality holds since F is Q-immersed in F V G (see Appendix A, Corollary 5.2). Hence, 
using (3.8) we conclude 


Ep('0|Jt V ^i) = Ep(V’|J^t), P-a.s. 

Consequently, (3.11) holds. 

Step 4: Now we show the required orthogonality, that is we prove claim (c). Towards 
this end it suffices to prove that all real valued (F, F)-martingales do not have common 
jumps with X under P (see Remark 2.12). Let us take Z to be an arbitrary real valued 
(F, P)-martingale. Then, in view of (3.8) Z is an (F, Q)-martingale. By (13), we have that 
(F, Q)-martingales and Poisson processes in M are independent under Q. Thus, by Lemma 
5.3 in the Appendix A, the Q probability that process Z has common jumps with any process 
from family M is zero. Consequently, in view of (3.5), the (F, Q)-martingale Z does not 
jump together with X, Q-a.s. Therefore, by absolute continuity of P with respect to Q, P 
probability that Z jumps at the same time as X is zero. 

Step 5: Finally, we will show that (3.9) holds. Towards this end, let us take an arbitrary 
real valued function h on S. The abstract Bayes rule yields 

Ep(/i(X )|J't) = ^ EQ(EQ(h(Xo)?7r|go)|7'r) 

° ^ EQ(r/T|Xr) EQ(EQ(r/T|ao)|Xr) 

= EQ(/i(Xo)EQ(77r|^o)|-PT) = Eq(/i(Xo)| Xt) = EQ(h(Xo)| Jo), 

where the last equality follows from the fact that by assumption (3.2) the initial condition 
of the process X satisfies 


Q(Xo = x\Xt) = Q(Xo = x| Jo), x € 5. 


(3.12) 


Consequently, 

Ep(h(Xo)|Jo) = Ep(Ep(/i(Xo)|J-r)| Jo) = Ep(EQ(h(Xo)| Jo)| Jo) = EQ(h(Xo)| Jo) 
= Ep(h(Xo)|JT). 


This completes the proof of (3.9), and the proof of the theorem. 


□ 
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4 (F, G)-CMC vs (F, G)-DSMC 

In this section we first re-visit the concept of the doubly stochastic Markov chain. Then, 
we study relationships between conditional Markov chains and doubly stochastic Markov 
chains. These relationships are crucial for the theory of consistency of CMCs and for the 
theory of CMC copulae, that are put forth in the companion paper [6]. 


4.1 (F,G)-DSMC 

We start with introducing the concept of (F, G)-doubly stochastic Markov chain ((F, G)- 
DSMC for brevity), which generalizes the notion of F-doubly stochastic Markov chain (cf. 
[20]), as well as the notion of continuous time G-Markov chain. 


Definition 4.1. A G-adapted cddldg process X = *•5 called an {¥,G)-doubly 

stochastic Markov chain with state space S if for any 0 < s < t < T and for every y G S it 
holds that 

nxt = y\XTygs) = nxt = y\Xty a{Xs)). ( 4 . 1 ) 

We refer to [20] for examples of processes, which are (F, F^)-DSMCs. We remark that 
in [20] it was assumed that the chain X starts from some point x € S' with probability one, 
whereas here, we allow for the initial state Xq to be a non-constant random variable. 

With any X, which is an (F, G)-DSMC, we associate a matrix valued random field 
P = {P{s,t), 0 < s < t < T), where P{s,t) = {pxy{s,t))x,yeS is defined by 


Px,yis, t) 


P(W = y,Xs=x\ Pt) 
P(X, = x\Pt) 


l{P(X,=a;|J-t)>0} + l{x=j/}l{P(X,=x|J-t)=0}- 


(4.2) 


The following result provides a characterization of (F, G)-DSMC. 


Proposition 4.2. A process X is an (¥,G)-DSMC iff there exists a stochastic matrix valued 
random field P{s,t) = {Pxyis,t))x,yeS: 0 < s < t < T, such that: 

1) for every s € [0,r], the process P{s, •) is ¥-adapted on [SjT], 

2) for any 0 < s < t < T and for every x,y £ S we have 

= y \ J^T Gs) = ^{Xs=x}Pxyis, t) (4.3) 

or, equivalently, for every y £ S we have 

P{Xt = y I J't V ^s) = ^ ^{Xs=x}Pxyis, t). (4.4) 

xGS 


Proof. We first prove the sufficiency. Using (4.3) we have that 

P(Xi = y \ PtW g^) = ^{Xs=x}Pxyis,t). 

x£S 


(4.5) 
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So, taking conditional expectations with respect to V cr^Xg) on both sides of (4.5), ob¬ 
serving that Xt\/ a{Xs) C and using the tower property of conditional expectations, 

we obtain 

¥{Xt = 2/ I J) V a{Xs)) = '^l{Xs=x}Pxy{s,t) \ Tt V (y{Xg^ = J2'^{Xs=x}Pxy{s,t), 

^xeS ' xeS 

where the last equality follows from measurability of Ylx€S^{Xs=x}Pxy{s,t) with respect to 
Xt V a{Xs). This and (4.5) imply 

F{Xt = y\XT'Vgs)= nXt = y I V a(X,)), 


which is (4.1). 

Now we prove the necessity. First we observe that, using similar arguments as in 
Jakubowski and Niew^glowski [19, Lemma 3] (see also Bielecki, Crepey, Jeanblanc and 
Rutkowski [3, Lemma 2.1]), we have that for t > s 

r{Xt = y\Xtya{Xs)) (4.6) 

= ^{X=x} 

xGS 

Consequently, in view of (4.2) we have 

P(Xt = y I 7) V 0-(X5)) = '^l{x,=x}Px,yis,t)- 

x£S 

It is enough now to let Px,y{s, t) = Px,y{s, t), for x,y G S,0 < s < t < T. □ 

As we saw in the proof of Proposition 4.2 we can take P = P, where P is given by (4.2). 

Remark 4.3. Observe that, in view of the results in Rao [24], we have that for every s G [0, T] 
and almost every oj G GL the function P{s,-) is measurable on [s,T], and that for every 
t G [0,T] and almost every to G Gt, the function P{-,t) is measurable on [0,t]. 

This, and (4.3) justify the following definition 

Definition 4.4. The matrix valued random field P = {P{s,t), 0 < s < t < T), defined by 
(4.2) is called the conditional transition probability matrix field (c-transition field for short) 
ofX. 

Remark 4.5. For the future reference, we note that (4.4) in the definition of an (F, G)-DSMC, 
can be written in the following form (recall that we take P = P): 

E{Hf \ PtV Gs) = '^ Hfpxy{s, t) for every y G 5, 
x£S 


F{Xt = y,Xs = x\Pt) 
P(X, = x\Pt) 


l{P(X,,=a:|J-t)>0} + '^{y=x}'^{¥(Xs=x\Ft)=0} ) P “ O-S 


which is equivalent to 


E{Ht I PTyGs) = P{s,tVHs. 


(4.7) 
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We know that in the case of classical Markov chains the transition semigroup and the 
initial distribution of the chain characterize the finite dimensional distributions of the chain, 
and thus they characterize the law of the chain. The next proposition shows that, in case of 
an (F, G)-DSMC X, the c-transition field P of X and the conditional law of Xq given Tt 
characterize conditional law of X given 


Proposition 4.6. If X is an {¥,G)-DSMC with c-transition field P, then for arbitrary 
0 = to<ti<...<tn<t<T and (xi,..., Xn) € 5'”' it holds that 

n—1 

P(Xi^ = Xi, . . . Xt^ = Xn I Xt) = ^ P(Xo = Xo|Xt) n Pxk,Xk+i{l'k,tk+l)- (4.8) 

xqGS k=0 

Moreover, if 

F(Xo = xo|Xr) = P(Xo = xo|Xo) for every xq e S, (4.9) 

then for arbitrary 0<ti<...<tn<t<T and (xi,..., x^) € 

P(Xt^ = Xi,.. .Xt^ = Xn I Xt) = P(Xti = Xi,.. .Xt^ = Xn I Xt). (4.10) 

Proof. Let us fix arbitrary xi,..., Xn € S and 0<ti<...<tn<t<T, and let us define 
the set A by 

A = {Xt^ = xi,... ,Xt^ = Xn}. 

Note that by Lemma 3.1 in [20] we have 

n—1 

P(.4|XTVe„)l,.v..„, = l,x..™)n (ifc) ^fc+l)- 

k=0 

Consequently, 

n—1 

P(X I Xt) = ^ P(Xo = xo|Xr) Pxk,xk+i{tk,tk-ei) 

xqGS k=0 

which proves (4.8). Thus, in view of (4.9), the following equality is satisfied 

n—1 

P(X|Jt) = ^ P(Xo = xojXo) n Pxk,Xk+i{tk^ tk-el)- 

xqGS k=0 

Since P is a c-transition field we obtain that P(X|Pr) is Xt measurable as a product of Xt- 
measurable random variables. Thus, the tower property of conditional expectations yields 
(4.10). □ 

Corollary 4.7. Let X be an {¥,G)-DSMC with Xq satisfying (4.9). Then F is ¥-immersed 
m F V F^ . 


Proof. In view of Proposition 4.6 process X satisfies (4.10). This, by [19, Lemma 2], is 
equivalent to P-immersion of F in F V F^. □ 
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In analogy to the concept of F-intensity for (F, G)-CMCs, one considers the concept of 
intensity with regard to (F, G)-DSMCs. Definition 4.8 introduces a concept of such intensity. 
This definition is stated in the form, which is consistent with the way the original definition 
of intensity for DSMCs was introduced in [20]. Later on, we will show that this definition 
can be equivalently stated in the form analogous to Definition 2.3. 


Definition 4.8. We say that an ¥-adapted matrix-valued process T = (r 5 )s>o = {hs%,yes) s>0 
is an intensity of {¥,G)-DSMC X if the following conditions are satisfied: 

1 ) 

[ J2\^r\ds< 

Mt] tri 


oo. 


xGS 


2 ) 


>0 yx,y G S,x ^y, iT = - ^ Vx G S. 

y&S:yj^x 

3) The Kolmogorov backward equation holds: for all v <t, 

P{v,t)—1= f TuP{u,t)du. 

J V 

4) The Kolmogorov forward equation holds: for all v < t, 

P{v,t)—l= f P{v,u)Tudu. 


(4.11) 

(4.12) 


(4.13) 


(4.14) 


Remark 4.9. The above Kolmogorov equations admit unique solution provided that T sat¬ 
isfies (4.11). The unique solution of Kolmogorov equation (4.13) is given by the formula 
which is known as Peano-Baker series 


^ pt pt pt 

i + E / / ••• / r,,...r, 

n=l'^'^ Jvn-i 


P{v,t) = 


^dvn . ..dvi, 


and the solution of (4.14) is given by 

rt rvi 


Piv,t) = 


^ pt pvi pVn-1 

i + E/ / •••/ 


dvn...dvi. 


There is also a different useful representation of the solution of Kolmogorov equations. It is 
given in terms of a matrix exponential, and it is called the Magnus expansion: 


P{v,t) = exp(4>(u,t)). 


k=l 


where <h(u,t) is the Magnus series 
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We refer to Blanes, Casas, Oteo and Ros [10] for a detailed statement of the Magnus expan¬ 


sion in deterministic case. The formulae found in [10] are adequate in our case, as here we 
use the Magnus expansion of P{v,t) for every w G fl. 

It is easily seen from the Magnus expansion, that P{v, t) has inverse Q{v, t) = exp(—$(r;, t)). 


For an alternative proof of invertibility of P{v,t) we refer to [20, Proposition 3.11.iii)]. 


4.1.1 Martingale characterizations of (F, G)-DSMC 

It turns out that the (F, G)-DSMC property of process X is fully characterized by the mar¬ 


tingale property (with respect to the filtration G given by (2.1)) of some processes related 
to X. These characterizations are given in the next theorem. 

Theorem 4.10. Let (^t)fe[o,T] ^6 S~valued stochastic process and (ri)f£[o,T] ^6 1^' 

adapted matrix valued process satisfying (4.11) and (4.12). The following conditions are 
equivalent: 

i) The process X is an {¥,G)-DSMC with the intensity process T. 
a) The processes defined by 



(4.15) 


are G - local martingales. 

Hi) The processes defined by 



(4.16) 


where 



(4.17) 


are G - local martingales, 
iv) The process L defined by 


Lt:=ZjHt, 


(4.18) 


where Z is a unique solution to the random integral equation 


dZt = —TtZtdt, Zq = I, 


(4.19) 


is a G-local martingale. 

v) For any t G [0,T], the process defined as 


NI := P{s, t)^Hg for 0 < s <t. 


(4.20) 


is a G martingale, where 

P{s,t) ■=ZsYt 


with 


dYt = YtTtdt, Yo = l, t€[0,T] 
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Proof. The proof of equivalence of (i)-(iv) goes along the lines of the proof of [20, Theorem 
4.1]; only minor and straightforward modifications are needed, and therefore the proof is 
omitted. Equivalence of (iv) and (v) follows from formula 

Nl = Y^'^Ls for 0 < s < t 

and the fact that is uniformly bounded Go measurable invertible matrix (Lemma 5.4). □ 

The following result is direct counterpart of Proposition 2.6 and therefore we omit its 
proof. 

Proposition 4.11. Let X be an {¥,G)-DSMC. 

i) //r and T are intensities of X, then they are equivalent relative to X. In particular 
intensity of X is unique up to equivalence relative to X. 

ii) Let T be an intensity of X. IfT is an ¥-adapted process equivalent to T relative to X, 
then T is intensity of X. 

We will not discuss here the question of existence of an (F, G)-DSMC with intensity 
(rt)te[o,T]- This question will be addressed in some generality in Bielecki, Jakubowski and 
Niew^glowski [4]. Instead, in the next section, we will show that any (F, G)-CMC process 
X constructed in Theorem 3.4 is also an (F,G)-DSMC. 

Since an (F, G)-DSMC X is a 5-valued cadlag process, then it is a pure jump semimartin¬ 
gale. This observation sheds a new light on the intensity of X as the following corollary 
shows. 

Corollary 4.12. Intensity of an {¥^G)-DSMC X is an ¥-intensity of X in the sense of 
Definition 2.3. 

Proof. The process M is a G-local martingale by Theorem 4.10.ii). In fact, it is also an 
F V G-local martingale. To see this, we take a reducing sequence of G-stopping times 

Tn ■= inf {t > 0 : f > n}. 

■^0 yes 

Since M is also F V G-adapted and {Tn)n>i are also F V G stopping times we see that M 
is an F V G-local martingale (see e.g. [14, Theorem 3.7]). This implies that the F-adapted 
process T is an F-intensity of X. 

4.2 Relation between CMC and DSMC 

In this section we present some aspects of relationship between the classes of (F, G)-CMCs 
and (F, G)-DSMCs. 
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4.2.1 DSMCs that are CMCs 


Proposition 4.13. Assume that F and G satisfy the immersion property (2.10), and that 
X is an {¥,G!)-DSMC. Then X is an {¥,G)-CMC. In addition if X considered as an (F,G)- 
DSMC admits intensity P, then X considered as an {¥ ,G)-CMC admits ^-intensity A = P. 


Proof. Let us fix arbitrary xi,... ,Xk € S and 0 < t < ti < ... < < T, and let us define 

a set A by 

A = {Xt^ = xi,... ,Xti^ = Xk}. 

We need to show that 

¥{A\PtVgt)=F{A\XtVa{Xt)). (4.21) 

Towards this end we first note that by Lemma 3.1 in [20] we have 


k-l 

F(yA\J-T y Qt)^{Xt=x] ~ ^{Xt=x}Px,xi{t,t-i) '^^Pxn,Xn+i{tn:tn+l)- (4.22) 

n=l 


The tower property of conditional expectation and (4.22) imply 


F{A\Tt V t?t) = E I ^E (1^|7 't V Qt) 'I{Xt=x}\^t 'I Qtj 
\x€S J 

~ ^ ^ ^ ^{Xt=x}Px,xi (C ^l) Pxn,Xn+i i^nt tn+l)\d't 'I Gtj 

\x£S n=l / 

~ 'y ^ ( Px,x\ (L ^l) Pxn,Xn+\ ifui ^n+l)|-^t 'I Gtj • 

x£S V n=l J 

Thus using the assumed immersion property of F in F V G we obtain 


^{Xt=x}^ ( Pa;,xi(L^l) 

x£S \ n=l J 

which implies the CMC property. 

The second claim of the theorem follows immediately from Corollary 4.12. 
The following example illustrates the use of Proposition 4.13. 


F{A\Xt yQt) = Y. 


k-l \ 

'WPxn,x„+i{tnitn+l)\d~t 1 ) 


□ 


Example 4.14. (Time changed discrete Markov chain) Consider process C, which is a 
discrete time Markov chain with values in S = {l,...,iP} and with transition probability 
matrix P. In addition consider process N, which is a Cox process with cadlag F-intensity 
process A. From [19, Theorem 7 and 9] we know that under assumption that the processes 
{Ck)k>o s-iid (A^t)tg[o,r] independent and conditionally independent given J-y, the process 


Ct := Cxt 
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is an (F, F‘^)-DSMC. Moreover C admits intensity process F = [ 7 ^^] given as 

7 ^ = {P- 

Thus, by Corollary 4.7 and Proposition 4.13, the process C is an (F,F‘^)-CMC with F- 
intensity A = F. 

4.2.2 CMCs that are DSMCs 

Theorem 4.15. Suppose that X is an (F, G)-CMC admitting an ¥-intensity A. In addition, 
suppose that X is also an {¥,G)-DSMC with an intensity F. Then F is an ¥-intensity of X 
and A is an intensity of X. 

Proof. It follows from Corollary 4.12 that F is an F-intensity. Thus by Proposition 2.6 
A and F are equivalent relative to X. Consequently, by Proposition 4.11 process A is an 
intensity of X. □ 

This and Proposition 4.6 imply 

Corollary 4.16. If X is an (¥,G)-CMC with ¥-intensity and also an {¥,G)-DSMC with 
intensity, then ¥-intensity (or, equivalently, intensity) and Xt- conditional distribution of Xo 
determine the Xt- conditional distribution of X. 

In case of process X constructed in Theorem 3.4 the result of Theorem 4.15 can be 
strengthen as follows. 

Proposition 4.17. Let X he a process constructed in Theorem 3.4, so that X is an (F, G)- 
CMC process with an ¥-intensity process A. Then X is also an {¥,G)-DSMC with an 
intensity process F = A. 

Proof. In Step 1 of the proof of Theorem 3.4 we showed that the processes x,y ^ S, 
X y, given by (3.10), are G-local martingales. Thus, by Theorem 4.10, X is an (F,G)- 
DSMC with intensity A. □ 

4.2.3 Pure jump semimartingales that are both CMCs and DSMCs 

Theorem 4.18. Let F, G satisfy the immersion property (2.10). Assume that S-valued G- 
adapted pure jump semimartingale X admits an ¥-intensity A. Moreover suppose that the 
orthogonality property (2.11) is fulfilled. Then X is an {¥,G)-CMC and an (¥,G)-DSMC 
with intensity A. 

Proof. In Theorem 2.11 we showed that X is an (F, G)-CMC. In order to prove that X is 
an (F, G)-DSMC it suffices to show that for for every A S Xt, B ^ Qt, t < u and y € 5 it 
holds that 


¥{\A^B^{Xu=y}) = ZiYuCy), 


(4.23) 
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where Y and Z are defined by (5.5) and (5.4), respectively. Indeed, by the monotone class 
theorem, the above yields 

^(-^u = V Qt) = hJZ tYuCy. (4.24) 

Consequently, since the right hand side of (4.24) is measurable with respect to J-t V o'(Xt) 
we obtain the desired (F, G)-DSMC property of X. 

It remains to prove (4.23). Since ZtYuCylA £ (see Lemma 5.4), the following 

formula 

Vs := lBHjE{ZsYueylA\Xs), s G [t,u], 

well defines a process V on [t,u]. Now, let a Doob martingale D be defined on [0,T] by 

Ds = E{\A^B'^{Xu=y}\^s V Qs), s G [ 0 ,r]. 

The immersion property (2.10) leads to 

Vt = \BHjE[ZtYuey\A\Xt V Qt) = E{1a^bHJZ tYuey\Tt V Qt). 

Next, we will show that Vt = Df, which in turn will imply that 

E(1a1b1{Xu=j/}) = EDt = EVt = E{\a^bHJ ZiYuCy), (4.25) 

which is (4.23). 

In order to show that Dt = Vt we will demonstrate a stronger result, namely that V = D on 
[t,u]. To this end, note that by Lemma 5.5 C is an F V G-martingale on the interval [t,u]. 
Thus, to show that V = D on [t,u] it suffices to show that Vu = Du- For this purpose, let 
us define on [u, T] the process W by 

Ws := lsl{x„=y}E(lA|-F's). 

Next we observe that for s G [u,T] 

Ds = tB^{X-a=y}^{^A\Ds V Qs) = l_Bl{Xu=j;}lE(lyl|T's) = Ws, 

where the penultimate equality follows from immersion of F in F V G. Hence, using the fact 
that ZuYu = I (see Lemma 5.4), we have 

Du = Wu = 1_b1{x„=j/}E(1a|-F„) = tBHueyE{tA\Du) = tBHuE{ZuYuey\A\Du) = K- 

Thus, by the martingale property of D and V (on [t,u]), we conclude that D = V on 
[t,u\. This completes the proof of (4.23) and, consequently, demonstrates that X is an 
(F,G)-DSMC. 

In order to verify that X admits intensity A we first note that the random field P defined 
as 

P{t,u) := ZtYu (4.26) 

solves the Kolmogorov equations (4.13) and (4.14). Next we observe that (4.24) implies the 
martingale property of N'^ given as in (4.20), with P{t,u) as in (4.26). Thus, by Theorem 
4.10, A is an intensity of X. The proof of the theorem is now complete. □ 
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5 Appendices 

Appendix A 

In this appendix we provide technical results needed for derivations done in Section 3. 

Lemma 5.1. Let ^ be an S-valued random variable defined on a filtered probability space 
(n, A, H, P) with El = Suppose that 

Ep(M6I^T)=Ep(h(0|i^o) (5.1) 

for every real valued function h on S. Then El is ¥-immersed m El V 

Proof. It is sufficient to prove (c.f. [9, Lemma 6.1.1]) that for every it holds 

that 

Ep(V'|'HtVa(0) = Ep(V^|?{d, VtG[0,r]. (5.2) 

Let us fix t G [0, T] and G By the standard tt — A system arguments it is enough 

to show that 


Ep(V^1a1b( 0) = Ejp(Ep(rA|?^0lAlB(O), (5.3) 


where 

1 , ?GB, 

0 , iiB. 



Towards this end we first derive another representation of the right hand side in (5.3), 


= Ejp(Ejp('i/)lA|^t)ls(0) = Ep(Ejp(Ejp(^lA|Wt)ls(OI^T)) 

= Ejp(Ep(^lA|'Ht)Ejp(lB(^)|'HT)) = Ep(Ep(^lA|'Ht)Ep(lB(^)|?^o)) 
= Ep(Ep(V'l^Ep(lB(^)|?^o)|'^t)) = Ep(V'l^Ep(lB(OI’^o)), 

where the fourth equality follows from (5.1). The left hand side of (5.3) can be rewritten as 

Ep('01a1b(O) = Ep(Ep(V>lAls(OI’^T)) = Ep('01aEp(1b(^)|^t)) 

= Ep(V'1aEp(1b(OI'^o)), 

where the last equality follows from (5.1). This proves (5.3) and thus concludes the proof of 
the lemma. □ 

Corollary 5.2. Let M. be a filtration on (fl, A, P), such that it is independent o/EI V (t(.^). 
Suppose that ^ satisfies (5.1). Then El is ¥-immersed in H V K V o'(0. 

Proof. The result follows from Lemma 5.1 and from the fact that if EI^ and EI^ are two 
independent filtrations on (fl, A, P), then EI^ is P-immersed in EI^ V EI^. □ 

In the next lemma we use the same probabilistic setup as in Section 2. 
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Lemma 5.3. Let X be an¥ adapted cddldg process, and let N he a Poisson process. Suppose 
that N and F are independent. Then 

F{{ioen:3te [0,T] s.t. AXt{uj)ANt{uj) / 0}) = 0. 

Proof. First note that both X and N have countable number of jumps on [0,T], and 
let denote their jump times as {Tn)n>i and {Sn)n>i: respectively. Independence of N and 
F implies that {Tn)n>i and {Sn)n>i are independent. Since each random variable Sn is 
Gamma distributed and thus has density, then for any n,k > 1 it holds that 

p(r„ = Sk) = 0. 


Since 


A:={uj:3t€ [0,r] s.t. AXt{uj)ANtiuj) / 0} = (J {w : Tn{uj) = 5fc(a;)} 

n,k>l 

we have 

P(A) < ^ P(T„ = Sk) = 0. 

n,k>l 


□ 


Appendix B 

In this appendix we derive some technical results that are used in Section 2 and Section 4. 
Lemma 5.4. Let Z and Y be solutions of the random ODE’s 


dZt 


dYt 


-'^tZtdt, 

Zq — t € [0,T], 

(5.4) 

-- Yt^tdt, 

Fo = I, tG[0,T], 

(5.5) 


where 4' is an appropriately measurable matrix valued process satisfying (2.5)® and such that 

f \^T\du < oo. (5.6) 

Then, the matrix valued random processes (Lj)o<t<r CLnd {ZtYy)Q<t<v, v € [0,T], have ele¬ 
ments that are nonnegative and bounded by 1. Moreover 

ZtYt = l forte[0,T]. 


For any lj for which 'F does not satisfy (2.5), we set = 0 for all t € [0, T]. 


(5.7) 
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Proof. Using Remark 4.9 one can verify that for each t, the functions Yf{-) and Zt{-) are 
measurable, so that Y and Z are matrix valued random processes. 

Since 4' satisfies (2.5), then for every oj, Y.(uj) is a solution of matrix forward Kolmogorov 
equation, and so its elements belong to the interval [0,1] (since they give conditional prob¬ 
abilities, see e.g. Gill and Johansen [15, Thm. 12 and Thm. 13]). 

Next, observe that, letting Z(t,v) = ZtY.^ we have that 

dtZ{t,v) = {dZt)Yy = —'^tZtYydt = —'kfZ(t, r)dt, 0 <t <v. 

Moreover, it is easy to verify that Z{v,v) = Z^^Y.^ = ZqYq = I. We thus see that for every 
cj, Z(-,v)(uj) satisfies the Kolmogorov backward equation, 

dtZ(t,v) = —'^tZ{t,v)dt, 0<t<v, Z{v,v) = l, 

and so, it has non-negative elements bounded by 1. □ 

The following lemma is used in the proof of Theorem 2.11. 

Lemma 5.5. Suppose that assumptions of Theorem 2.11 are satisfied. Let U be an M'^- 
valued bounded random variable, and let Z and Y be solutions of the random ODE’s (5.4) 
and (5.5), respectively. Fix u and v satisfying 0 < u < v < T, and fix set A £ Tu V Qu- 
Then, process V given by 

Vt = IaHJ ZtE(WU|T)), t £ [0,T], 
is an¥ y G martingale on the interval [u, v]. 

Proof. It suffices to prove that the process V given as 

Vt = HjZtE{Y,U\Pt), iG[0,r], 

is an F V G martingale on [0,r;]. Furthermore, since all components of Ht and ZiY^u are 
non-negative and bounded by 1 (for the latter see Lemma 5.4), and since random variable 
U is bounded, then it suffices to show that U is an F V G local martingale. 

Towards this end we first verify that vector valued process L = (L*, x £ S)^ defined by 
Lt := HJZt, t G [0, T], is an F V G-local martingale with the following representation 

Lt = Hq -|- f dMj-Zu, t £ [0,T]. (5.8) 

Jo 

Indeed, since A is an F-intensity, integration by parts yields that 

dLt = d(IL^Zt) = Hj_dZt + dHj -Zt = -Hj_AtZtdt + dHj -Zt = dUj-Zt. 

Next, we observe that the vector valued process U{-,v) = x G S)^ defined by 

u^t,v) = J2^{Yfiyuy\Yt), t£[o,T], 
yes 
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is an F-martingale. Since we assume that F is right-continuous we can take right-continuous 
modification of U{-,v). 

Thus, by assumptions (2.10) and (2.11) in Theorem 2.11, its components are orthogonal 
to components of M. Hence the square bracket processes [M^, U^{-,v)], x,y (z S, are F VG- 
local martingales. By properties of square brackets (cf. Protter [23, Thm. II.6.29]) we 
obtain 

yGS 

Thus, by predictability and local boundedness of Z, and by [23, Thm. IV.2.29], we conclude 
that process [L^,U^{-,v)] is a local martingale, and consequently that local martingales 
and U^{-,v) are orthogonal. Since, 

Vt = LtU{t,v)=Y,LfU"{t,v), te[0,T], 

x£S 

we conclude that V is an F V G-local martingale as a sum of local martingales. □ 
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